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Description 

Background of the invention 

[0001] The invention relates to a position detection 5 
system, a graphical user interface, a method and use 
thereof. 

[0002] In the recent years, position detection systems 
have developed quite tremendously and the systems 
known today are capable of detecting the position of a io 
stylus on a whiteboard in such a way that the image on 
a connected computer reflects the drawn image on the 
whiteboard with reasonable accuracy. 
[0003] This means that position detectbn systems 
have gained widespread use in especially corporate en- ts 
vironments where they are used to electronically docu- 
ment the topics of meetings or presentations in particu- 
lar 

[0004] However, the known position detection sys- 
tems suffer from the drawback that they require some 20 
technical expertise in order for them to be correctly in- 
stalled. This often means that installation of the system 
is a quite lengthy processes to be carried out ahead of 
e.g. a meeting which leads to less use of the system. 
The system will often only be used on special occasions 25 
when it is extremely necessary to document the matter 
of e.g. meeting. With less use, the danger of totally for- 
getting how to use the system arises and any expertise 
or knowledge of installing the system disappears quick- 
ly. 

[OOOq The user-friendliness of the systems during 
regular use is also quite limited, especially since the sys- 
tem comprises to separated parts: The system on the 
whiteboard and the computer usually situated at a dis- 
tance firom the whiteboard e.g. on table. 
[0006] The communication between the user and the 
computer is very important and requires that the user 
always has a good "picture" of what the computer is re- 
cording from the position detection system. However, 
with the known systems, the user can only gain this "pic- 
ture" by leaving the whiteboard and sit in front of the 
computer. Here, he has to perfomn different operations 
to gain the "picture" before he can retum to the white- 
board and continue his presentation on the whiteboard. 
This break in his presentation often means that the au- 
dience or he has lost concentration which makes the 
presentation less engaging. 

[0007] If the user instead concentrates on the presen- 
tation, there is risk of malfunction or wrong use of the 
system in the sense that the presentation is not recorded 
by the system. Also, it becomes very distracting to the 
user because he will wonder whether the system is func- 
tioning property or not. 

[0008] The object of the invention is to create a posi- 
tion detection system eliminating the above-mentioned 
problem. In particular, it is an object of the invention to 
create a position detection system with improved com- 
munication between the user and the system in relation 



to both installation and use. 
The invention 

[0009] When, as stated in claim 1 , a position detection 
system comprising at least one pointer device (13) at 
least one detector (11.12) adapted for detecting the po- 
sition of the at least one pointer device (13). signal 
processing means (19, 23a; 23e) for controlling the said 
at least one detector (11, 12) said system comprising a 
user interface, it is possible to enhance and improve the 
communication between the user and the system. 
[001 0] According to a preferred embodiment of the in- 
vention, the signal processing means is a separate com- 
puter or a part of a separate computer connected to the 
position detection system. It should however be empha- 
sized that the signal processing means can be incorpo- 
rated in one of the system components e.g. the penhold- 
er or even in parts be incorporated in t>oth the computer 
and a system component. 

[0011] The invention, as stated in claim 2, comprises 
a user interface comprising at least one light emitting 
arrangement, at least one sound emitting arrangement, 
routir^ means, saki routing means being adapted to 
routing fault states to said sound emitting anrangement 
and to routing no-fautt states to the light emitting ar- 
rangement. 

[001 2] According to the invention, the state of the sys- 
tem is deariy indicated to the operator in an advanta- 
geous intuitive and simple way. 
[0013] Hence, the user may not only rely upon fault- 
state indications but also on "all is weir-indicattons. Ap- 
plicable "all is weir-indication may vary from application 
to applicatk>n, but an advantageous "all Is weir-irKjica- 
tion is a light indication showing that the different com- 
ponents, especially the detectors, have been plugged 
into the system correctly. 

[0014] When, as stated in daim 3. the at least one 
light emitting arrangement comprises light indicating 
means integrated in the position detectors, the installa- 
tion of the system is kept simple and easy since the light 
emitting arrangement does not include further separate 
units. 

[0015] Also, the integration In the detectors ensures 
that the light emitting arrangement is always visible to 
user and usually emits light in the user's direction. 
[0016] When, as stated in daim 4. said user interface 
comprises at least one light emitting arrangement, it is 
possible to obtain a preferred embodiment of the Inven- 
tion. 

[0017] According to the preferred embodiment, the 
light signaling emitter comprises light emitting diodes. 
LEDs, e.g. incorporated in the system detectors and/or 
a penholder. Moreover, such light emitters may be inte- 
grated in the board. 

[001 8] According to a preferred emt>odiment of the in- 
vention, the light emitting anrangement may comprise a 
dear visual statement on the computer monitor control- 
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ling the application. It should nevertheless be empha- 
sized that such visual statement should always be read- 
able to the user of the system. 

[0019] The invention, as stated in claim 5, comprises 
at least one light emitting arrangement comprising light 5 
emitting means integrated in the position detectors. 
[0020] According to the invention, the incorporation of 
light emitters in the position detectors facilitates a user- 
comprehensible understanding of the detectors l^eing 
connected in the right manner. io 
[0021] The invention, as stated in claim 6. comprises 
a user interface comprising at least one sound emitting 
arrangement. 

[0022] According to a preferred embodiment of the in- 
vention, the sound emitting arrangement may e.g. com- 
prise loudspeakers incorporated in one of the system 
coniponents e.g. the penholder. 
[0023] According to another embodiment of the inven- 
tion, the system utilizes the loudspeaker of a computer 
which controls the system. By using the loudspeaker of 20 
the computer, it is possible to minimize the size and 
weight of the position detection system. This is espe- 
cially advantageous in connection with transportation of 
the system and with mounting of the system on e.g. a 
whiteboard. 25 
[0024] When, as stated in daim 7. said system com- 
prises routing means, said routing means being adapted 
to routing predefined fault states and no-fault states to 
signaling means, it is possible to device and control the 
interface of the system in an intelligent way. 
[0025] It should be emphasized that the different func- 
tions of state detection and state routing may be per- 
formed in many different ways. In other words, the rout- 
ing may be a set of statements incorporated in different 
routines of the software and/or it may be arranged in a 
software module handling different input states. The im- 
portant thing is that the overall function of the system is 
performed somewhere in the system hardware, i.e. the 
system routes the current states of interest (predefined) 
to the intended signalling means! 
[0026] When, as stated in daim 8, said routing means 
routes the fault states to said sound emitting arrange- 
ment and the no-fault states to the light emitting arrange- 
ment, it is possible to inform the user of a fault state in 
a secure manner Usually, it is easier to get the user's 
attention by means of sound than by means of light. The 
important thing is, however, that the user is quickly in- 
formed of any fault states and responds to such fault 
signals. 

[0027] The invention, as stated in daim 9, comprises 
a graphical user interface (GUI) for displaying data from 
a position detection system according to daim 1 , said 
GUI comprising program processing means induding 
time reference generator means for recording and stor- 
ing a sequence of images, said images referring to a 
time reference provided by said time reference genera- 
tor of at least two time lines, at least one image moni- 
toring area adapted to monitoring images of said record- 
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ed and stored sequence of images with reference to at 
least one of the said time lines, at least one of said time 
lines being adapted to monitoring a sub-interval of at 
least one of said at least two time lines. 
[0028] Hereby, it is possible for a user to monitor a 
sequence of images in a preferred manner. The two time 
lines allow the user to see and pick the images in a time 
period with higher and lower resolution on the time line. 
This allows the user to easily locate a particular image 
on the high resolution time line or to browse through a 
large number of images quickly with only small tiand 
movements on the low resolution time line. 
[0029] It should be noted that a time line should be 
interpreted broadly as a visual indication easy to com- 
prehend by the user of the system, thus providing the 
user information of when the image was recorded rela- 
tive to the other recorded images. According to the in- 
vention, a time line may preferably be a traditional time 
line as described and referred to in the description and 
the drawings of this application. 
[0030] A time line may comprise a number of squares, 
blocks, vertical lines, dots or simply a continuous line 
which has markings at regular intervals. 
[0031] It should also be noted that an image monitor- 
ing area should be Interpreted as any type of monitoring 
area, such as an area showing many thumb pictures 
with low detail resolution or an area showing one or a 
few very large and detailed pictures. A combination that 
includes the two is also possible 
[0032] When, as stated in daim 10, an image dis- 
played at the at least one monitoring area refers to a 
cursor refening to at least one of said at least two time 
lines, it is possible to overview the GUI in an easy way 
and locate the adual time position on the time line of the 
images being displayed. 

[0033] When, as stated in daim 11. the at least two 
time lines have different time resolutions, a further ad- 
vantageous embodiment of the invention has been ob- 
tained. 

[0034] The different time resolutions mean that the 
user can choose the one which is the most suitable for 
the present task. 

[0035] When, as stated In daim 12. the GUI further 
indudes a snapshot monitoring area comprising one or 
more snapshots, it is possible to see the images of the 
snapshot in a larger version and hereby be able to see 
more details, thus enchandng the user's possibility of 
locating the right image fast. 

[0036] When, as stated in daim 13, a snapshot in- 
dudes one or a sequence of images, a further advanta- 
geous embodiment of the invention has been obtained. 
[0037] The Induding of a numt>er of Images in snap- 
shots improves the search accessibility of the GUI be- 
cause it is easy to find the right snapshot among the 
limited number of snapshots and it is possible to "navi- 
gate" within the snapshot. 

[0038] When, as stated in daim 14. the GUI further 
indudes a text monitoring and/or editing area, it is pos- 
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sible to comment on the created snapshots. The com- 
ments make it easier for the user to remember and lo~ 
cate a snapshot or an image in a fast and advantageous 
way. 

[0039] When, as stated in claim 15. text of the text s 
monitoring and/or editing area is linked to at least one 
snapshot, it Is possible to recall the text by clicking on 
the snapshot or in another way activate the snapshot. 
[0040] By playing a sequence of snapshots or imag- 
eSt it will be possible to see the linked text in a text mon- io 
itoring area as a sort of subtitle changing with the snap- 
shots or the images. 

[0041] When, as stated in claim 16, at least one piece 
of sound is linked to at least one snapshot, it is possible 
to communicate the information of the snapshot in a is 
more accessible way. The combination of sound and the 
images within the snapshot may create a sort of multi- 
media session for the user where the session is closer 
to the "real life" perception e.g. of a presentation. 
[0042] When, as stated in claim 1 7, at least one of the 20 
snapshots is in a data format allowing export and/or im- 
port said snapshots between computers or between a 
computer and at least one other communication device, 
it is possible to communicate snapshots with other per- 
sons located anywhere if they have a computer with e. 25 
g. an internet connection. Especially with the text mon- 
itoring area, it will be possible to exchange comments 
relating to the snapshots. 

[0043] When, as stated in daim 1 8. a graphical user 
interface for displaying data from a position detection 30 
system according to claim 1 and at least one image gen- 
erating system, said GUI comprising a program proces- 
sor including a time generator wherein at least one in- 
tegrated image is created by integrating the at least one 
image firom the position detection system partly or fully 
in the at least one image of the image generating system 
in relation to time of the program processor including a 
time generator, an advantageous embodiment has t>een 
obtained. 

[0044] Hereby it is possible to create and store two 
different images together as one integrated image or as 
one image where the two images are layered on top of 
each other in relation to time. 

[0045] The projected image may be any kind of image 
including an image of a program where the program im- 
age may comprise areas for entering information. The 
image may also be basic elements of a drawing ready 
for additional drawing such as help lines or even a cor- 
porate image, color, or logo/trademark. 
[0046] When, as stated in claim 19, said integrated 
image is completely or partly scanned by a character 
recognizing system, it is possible to convert text written 
on the whiteboard to characters understandable to the 
computer. Hereby, It is possible to store numk>ers or 
words in a database, such as a financial database and 
make financial calculations on the basis of the numbers. 
[0047] In an advantageous embodiment of the inven- 
tion, the projector may be used to project results from 



e.g. financial operations on the whiteboard. 
[0048] When, as stated in daim 20, the result of said 
scanning is stored in one or more programs on at least 
one computer and/or controls said one or more pro- 
grams, a further advantageous embodiment of the in- 
vention has been obtained. 

[0049] The invention, as stated in daim 21 . comprises 
a position detection system comprising at least one po- 
sition detector (11 , 1 2) for detecting the positk>n(s) of at 
least one pointer (13) on at least one reference area 
(RA) means for mapping said position(s) relative to said 
at least one reference area (RA) into at least one data 
representation at least one image generating system 
(24) adapted for generating at least one image (I) on 
said at least one reference area (RA) according to image 
data (ID. BMP) said system comprising means for stor- 
ing the said pointer position(s) relative to the image data 
(ID) generated on the reference area (RA). 
[0050] The positions may be mapped into numerous 
different applicable data representations suitable for the 
purposes, such as different types of bitmaps or vector 
based formats. 

[0051] According to the invention, the pointer posi- 
tions may be stored in a relationship to the image data, 
thereby maintaining the mutual relationship between the 
recorded pointer position(s) and the image generated 
on the reference area. Thus, a complete image repre- 
senting both the "background" image and the image 
generated by the pointer may be established. 
[0052] Accordingly, the embodiment of the invention 
provides a possibility of providing an image on e.g. a 
whitetK>ard or at least a white background, detecting 
and storing the positions of a pointer drawing "on" the 
image in such a way that a complete image of both the 
projected (generated) image and the drawing made by 
the pointer may be stored. 

[0053] Evidently, such an image may be stored in sev- 
eral different ways. e.g. in a traditional CAD program, 
where one the layers is the generated image and where 
another layer comprises the drawing made by the point- 
er "on" the generated or projected image. Accordingly, 
the recorded pointer positions may be edited without ed- 
iting the bacl<ground image. 

[0054] When, as stated in daim 22, said image gen- 
erating system (24) comprises an image projecting sys- 
tem. 

[0055] According to the invention, a traditional image 
projection system may be applied for generating an im- 
age on a reference area, e.g. a whitet>oard. 
[0056] When, as stated in daim 23, said means for 
storing the said pointer position(s) (13) relative to the 
image data (ID) generated on the reference area (RA) 
are adapted for merging at least one data representation 
and the at least one image data into one image file. 
[0057] According to the invention, the image file may 
be represented in one file readable by conventional im- 
age readers. Applicable file formats may e.g. be Bitmap, 
JPEG or even vector based drawing formats. 
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[0058] The invention, as stated in claim 24, comprises 
a position detection system comprising at least one po- 
sition detector (11, 12) for detecting the position (s) of 
at least one pointer (13) on at least one reference area 
(RA) means for mapping said position(s) relative to said 
at least one reference area (RA) into at least one data 
representation at least one image generating system 
(24) adapted for generating at least one image (I) on 
said at least one reference area (RA) according to image 
data 0 said image generating system generating an im- 
age representing the dynamic interface of a computer 
program running on a computer, said system comprising 
character recognition means for converting at least 
some of the said data representations into digitally rep- 
resented characters, and said system comprising 
means for inserting the said digitally represented char- 
acters into the running program via the said dynamic 
computer interface. 

[0059] According to the invention, the detection sys- 
tem may be applied for writing characters Into e.g. a text 
processor or e.g. a spreadsheet, thereby using the im- 
age generated on the reference area as a virtual inter- 
face to a computer and thereby controlling the running 
program by the pointer. 

[0060] It should be noted, that the pointer, according 
to a preferred embodiment of the invention may advan- 
tageous include means for switching the functionality of 
the pointer between a "mouse** operation on the appli- 
cation or a "character fill-in" operation including the 
above mentioned character recognition and conversion. 
[0061] When, as stated in dairn 25, said image gen- 
erating system (24) comprises an image projecting sys- 
tem. 

[0062] According to the invention, a traditional image 
projection system may be applied for generating an im- 
age on a reference area, e.g. a whiteboard. 
[0063] Other possible applications may e.g. a large 
display as image generating means. 
[0064] When, as stated in daim 26, a graphical user 
interface for displaying data from a position detection 
system according to daim 1, said GUI comprising a 
snapshot monitoring area, said snapshot monitoring ar- 
ea incorporating snapshot selecting means, said snap- 
shot selecting means facilitating display of at least one 
of the images associated with the selected snapshot, it 
is possible to overview the snapshots easily in a con- 
trollable way. 

[0065] When, as stated in daim 27, said snapshot se- 
lecting means fedlitating display of a sequence of im- 
ages, starting with the image associated with the select- 
ed snapshot a preferred embodiment of the invention 
has been obtained. 

[0066] Especially the possibility of ''navigating** within 
a snapshot and seeing every image in a snapshot in a 
controllable way is advantageous. 
[0067] It shall be emphasized that the snapshot se- 
lecting means can be controlled in many ways e.g. by 
dicking directty on the snapshot, by using a keyboard 



incorporated in the GUI or by using computer keyboard 
combinations. 

[0068] When, as stated in daim 28, the snapshot se- 
lecting means comprises a PLAY control, the user 
5 friendliness of the system is enhanced. If the selecting 
means Is combined with other conti-ol functions such as 
FAST FORWARD placed in proximity of the PLAY con- 
trol, it is possible to control the selecting means very 
easily and in a manner which is immediately under- 
go standable to most people because of the similar con- 
struction of CD players and tape recorder keyboards. 

Figures 

f 5 [0069] The invention will be described in the subse- 
quent text with reference to the figures, where 

fig. 1 shows a overview of the invention, 

20 fig. 2 illustrates principles of an audio-visual part 
according to a prefenred embodiment, 

fig. 3 illustrates possible routing of states, 

25 fig. 4 shows a first prefen-ed embodiment of a posi- 
tion detection system with image projecting 
means, 

fig. 5a shows a second embodiment of a posltk>n de- 
30 taction system with image projecting means, 

fig. 5b shows a flow chart of one embodiment of the 
Invention, 

35 fig. 6 shows a GUI for a position detection system, 
fig. 7 shows part of the time lines in the GUI, 
fig. 8 illustrates the prindples of time line creation. 

40 

fig. 9 illustrates a GUI with snapshot selecting 
means, 

fig. 10 illustrates different snapshot opportunities, 
45 and 

fig. 11 illustrates the exchange of GUI between two 
computers or between a computer and a conn- 
munication devtoe. 



50 



Detailed description 



[0070] Figure 1 shows an overview of the invention. 
It comprises a position detection system induding two 
55 or more positions detectors 11,12 placed in the comers 
of a foundation 10 such as a writeabte k>oard and pref- 
erably a whiteboard or a blackboard. The detectors 11. 
12 are designed to detect the position of a writing unit 
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13, such as a whiteboard pen or a stylus housing a pen. 
The detectors are preferably infrared (IR) detectors and 
may either be integrated in the board or mounted onto 
the surface of the board by some mounting device, pref- 
erably magnets. Further, it comprises a control box with 5 
central processing hardware of the whole system built 
into a penholder 18, preferably mounted under or inte- 
grated in the board. The detectors 11, 12 are connected 
to the penholder 1 8 by cables 16,17 either Inside, at the 
back of or along the edges of the board. io 
[0071] The penholder 18 is connected to a power sup- 
ply which may be a main power supply such as a do- 
mestic power supply. The power supply may also be a 
battery power supply e.g. incorporated in the penholder 
18. The detectors 11,12 receive the necessary power is 
from the penholder 18 e.g. transmitted in the cable con- 
nections 17. 18 which also are used for position data 
transmission. In another embodiment of the invention 
the detectors each has its own battery power supply. 
[0072] A computer 19 communicates with the cable 20 
system of the penholder 18 and the detectors 11 , 12 by 
means of a wired or wireless communication. According 
to the illustrated emtKKliment, the computer 19 controls 
the system. 

[0073] The penholder 18 may comprise a serial or 2s 
parallel signal interface to the computer 19 to be used 
in relation to data transfer between the two. The inter- 
face may comprise a wired or a wireless connection to 
the computer as mentioned atK)ve. In a preferred em- 
bodiment of the invention the connection is a bluetooth 30 
connection. In another preferred embodiment the trans- 
fer Is accomplished by storing data on a storage media 
such as flash RAM and subsequently moving the RAM 
from one to the another. 

[0074] If the signal processing means is Incorporated 
In a system component such as the penholder and a 
separate computer is used it will be possible to reduce 
the data traffic in a connection between the computer 
and the detector system. Hereby it is possible to use a 
type of connection with a lower band width such as a 
cordless connection. 

[0075] The pen 13 is provided with IR diode-based 
communication means intended for transmission of the 
state of the pen 13 to the detection system 11. 12, 18 
by means of coded Information. A transmission state 
may e.g. be on/off corriniunlcation to the system detect- 
ed by the pen and communicated to the system e.g. to 
the detectors 11, 12. Other possible states may e.g. be 
the color of the pen, or the diameter and form of the pen 
tip. 

[0076] The detection of the pen 13 may be based on 
retro-reflective detection performed by the detectors 11 , 
12. The detectors comprise light emitting means, typi- 
cally IR light emitting means. The light emitting means 
are focused on the writing surface. Moreover, the detec- 
tors 11, 12 comprise light receiving means adapted to 
receiving light emitted from the detectors and reflected 
from retro-reflecting means mounted on the pen 13. 



thereby facilitating position detection e.g. by means of 
position detecting methods known within the art. 
[0077] Other detection methods known within the art 
may be used in connection with detecting the position 
of the pen 

[0078] Moreover, the detectors 11, 12 comprise light 
emitters 14, 1 5. e.g. LEDs. controlled by the system con- 
trol. The light emitters emit wavelengths perceivable by 
the human eye. 

[0079] Moreover, the system comprises loudspeaker 
means 17 incorporated in the computer 19 and/or the 
penholder 18. 

[0080] Figure 2 illustrates the principles of an audio- 
visual part of the man/machine user interface according 
to a preferred emt>odiment of the invention. 
[0081] The flow chart in figure 2 illustrates the detec- 
tor system in a given state S. The state of the system, 
or at least some of the states of the system, is monitored 
by a state-mapper SMT into basically two different "state 
groups", i.e. a group of states representing a no-fault 
state NFS, and a group of fault-states FS. It should be 
emphasized that the state-mapper SMT does not nec- 
essarily have to be installed as a separate "body" of soft- 
ware, but may typically be implemented by means of lo- 
cal branching from the different loops and routines of 
the software running the detector system. 
[0082] The no-fault state group NFS and the fault 
state group FS are coupled to state router means SRM. 
The state router means routes input states to the desired 
signaling means VS, AS according to a predefined rout- 
ing method. 

[0083] According to a preferred embodiment of the in- 
vention, the no-fault state group NFS invokes the output 
of a visual output signal VS indicating that the system is 
working property an6 as intended. 
[0084] Likewise, according to a preferred embodi- 
ment of the invention, the fault state group FS invokes 
the output of an audio output signal AS indicating that 
the system is malfunctioning. 

[0085] It should be noted that the system typically in- 
dicates a number of predefined no-fault states actively. 
Likewise, the system typically indicates only a numt)er 
of predefined fault conditions actively. 
[0086] The way of detecting the fault- and no-fault 
states may vary significantly from application to appli- 
cation and the choice of the signal-invoking states may 
also vary significantly as well. 

[0087] Moreover, the signal invoking states may be 
suitably routed in several different ways. 
[0088] Figure 3 illustrates possible routings of the 
states to the audio and light signaling system. 
[0089] The state routing means SRM will route the 
predefined states to two different visual signals, a first 
signal VS1 defining continuous activation of the light 
emitting VS arrangement, the second signal VS2 defin- 
ing a flashing activation of the light emitting arrangement 
VS. 

[0090] Moreover, the state routing means SRM will 
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route the predefined states to two different audio sig- 
nals, a first signal AS1 defining continuous activation of 
the sound emitting AS arrangement, the second signal 
AS2 defining a different activation of the sound emitting 
arrangement AS, e.g. in the form of another tune. s 
[0091] According to a preferred embodiment of the in- 
vention, the predefined fault-states are all routed to the 
sound emitting arrangement AS, whereas the prede- 
fined no-fault states are all routed to the light emitting 
VS arrangement. io 
[0092] A possible visual signal invoking state may e. 
g. be a "connection mode", determining that the system 
detectors 11, 12 of figure 1 are correctly connected to 
the penholder 18. Such states may e.g. be indicated by 
means of the at>ove-mentloned first method VS1 , i.e. by is 
continuous activation of the light emitting VS arrange- 
ment. 

[0093] A further visual signal invoking state may e.g. 
be a "write-detection mode", where the detectors 11,12 
are detecting that the pen 13 is used for writing on the 20 
associated board 10. e.g. a whiteboard, and that the de- 
tecting coordinates are appropriately obtained and 
stored in the computer 19 controlling the system. Such 
states may be advantageously monitored by means of 
the above-mentioned second method VS2, e.g. by dis- 2S 
Crete flashing of the light emitting arrangement VS. 
[0094] A further signal invoking state, now a fault 
state, is that the user is writing on the board 10 outside 
the range of the detectors 11,12 and/or outside the soft- 
ware-defined monitoring area of the computer 19. Other 
fault states will be invoked if the user uses more than 
one pen at the same time, if something or someone is 
In between detectors 11, 12 and the pen 13 or If one 
detector 1 1 , 1 2 is not "seeing" the pen when the other is. 
[0095] It should be emphasized that the different func- 
tions of state detection and state routing may be per- 
formed in many different ways. The important thing is 
that the overall function of the system is performed 
somewhere in the system hardware. 
[0096] Moreover, it should be emphasized that the 
light signaling system VS may comprise one or several 
light emitters, and that the light emitters may e.g. be In 
different colors, whereby different kinds of states may 
be routed to the light emitters having different colors. 
[0097] Moreover, it should be emphasized that the 
predefined number of fault states and no-fault states 
may typically be a subset of the total possible fault states 
and no-fault states, respectively. Hence, the states may 
be detected and derived from the system process in 
many different ways. 

[0098] According to a further embodiment of the in- 
vention, a light emitter may even comprise a dear visual 
statement on the computer monitor controlling the ap- 
plication. It should nevertheless be emphasized that 
such visual statement should always be readable to the 
user of the system. It should likewise be noted that the 
light signaling comprises light emitters 14, 15 incorpo- 
rated in the system detectors 11,12 and/or a penholder 



18 according to a preferred embodiment of the inven- 
tion. 

[0099] According to a preferred embodiment the in- 
vention, the sound emitting arrangement may e.g. com- 
prise loudspeakers incorporated in one of the system 
components e.g. the penholder 18. According to anoth- 
er embodiment of the Invention, the system utilizes the 
loudspeaker of a computer 19 controlling the system. 
[0100] In figure 4, a computer 19 for controlling the 
position detection system is illustrated. The computer 

19 is built up in a traditional manner with a central unit 
23a. The central unit 23a includes program processing 
means, including a time generator 23e, e.g. included in 
a microprocessor, which may perform or control the 
compilation of computer programs. The time generator 
of the program processing means is a source of time 
signals or time synchronizing signals for computer pro- 
grams where the time generator may be a part of the 
program processing means or a separate unit associat- 
ed with the processing means. The central unit 23a fur- 
ther includes a storage medium and memory. 

[0101] In addition, the computer 19 has a screen 23b 
on which a graphical user interface (GUI) 30 is shown, 
a keyboard 23b, and a computer Input device 23d where 
the computer input device Is a computer mouse In this 
embodiment but could also be e.g. a trackball, a com- 
puter pen or a similar computer input device. 
[0102] The computer 19 may be connected to other 
computers i.e. a server computer in the area network 
through an intemal network. The computer 19 may also 
be connected to other distant computers through an ex- 
temal network such as the Intemet or similar connection 
networks. 

[0103] The storage medium In the computer 19 will 
usually be used as the initial storage means for the po- 
sition data. GUI data etc. Secondly, the data could t>e 
transported to other computers in different forms. 
[01 04] Figure 4 further shows a picture 26 drawn with 
the pen or stylus 13 where the positions of the pen or 
stylus are detected by the |x>sition detectors 11,12 and 
converted into a picture in the GUI 30. 
[01 05] In a preferred embodiment of the Invention, the 
posltk>n system further includes an image generating 
system 24 such as a projector, the projector being po- 
sitioned in such a way that an image is projected onto 
the foundation 10 of e.g. a whitet>oard or a blacktx^ard. 
The projector 24 may be positioned in front of the foun- 
dation or behind it e.g. projecting an image onto a semi 
of fully transparent foundation. The projected Image will 
then have to be laterally reversed. 
[0106] Other types of image generating systems are 
possible I.e. a whiteboard on which a fixed image Is Im- 
printed onto the surface of the foundation and at the 
same time predefined in the GUI 30. 
[0107] The projector 24 has an electrical connection 
25 to the computer 19 for transfer of the image to be 
projected from the computer to the projector and/or from 
the projector to the computer and the GUI 30. 
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[0108] The image to be projected may be any kind of 
image exemplified by a net 27 of horizontal and vertical 
lines in fig. 4. The net 27 will assist the user of the pen 
or stylus 13 in creating the picture. 
[0109] In another embodiment, the projected image 5 
could be a picture where the user draws circles or lines 
onto areas of the picture with the pen or stylus for ex- 
planatory reasons. 

[0110] In a third embodiment, the projected image 
could be part of a picture where the user draws the final io 
elements. If the user wants to illustrate different final el- 
ements, he only has to remove the previous elements 
from the foundation 10 and draw new final elements on- 
to the same projected image or to a new one. An exanrv 
pie is a projected roadmap where the user draws differ- is 
ent route suggestions. 

[0111] In the GUI on the computer 19, the projected 
image 27 and the drawn picture 26 are usually integrat- 
ed into one image. However, in a situation where only 
the drawn picture 26 is desired, the projected image can 20 
be left out by the GUI 30. 

[0112] Figure 5 illustrates another preferred embodi- 
ment of the invention where an image I is projected onto 
the foundation 10. The image I is illustrated as a form 
with different question areas 28 where text may be filled 25 
in. 

[0113] Before any text is filled in the areas it usually 
will be necessary to perform a calibration of the position 
detection system in relation to the projected image I and 
vice versa to ensure a synchronization between the two. 
The calibration may be a positioning of the pen 1 3 in the 
comers of the image and letting the position detection 
system detect the positions. The GUI may the compare 
the detected positions with the knowledge it already has 
about the projected image and subsequently calibrate 
in relation to the result. 

[0114] The position detectors 11. 12 detect the posi- 
. tions of the pen or stylus 13 during creation of the text 
which is written in the areas and transferred to the GUI. 
in the GUI, the text will be integrated in the projected 
image in the areas. 

[0115] In a preferred emtK>diment, the GUI also in- 
cludes a character recognizing system which recogniz- 
es and converts written text to characters recognizable 
to the computer 19. 

[01 1 6] The text could be different kinds of infonmation 
such as numbers in a financial presentation where it is 
important that the numbers are readable and do not re- 
sult in misinterpretations. Also, it is possible to write 
numbers in an ariea on the fouridation 10 and to have 
these numt)ers detected, converted and transferred to 
a financial or database computer program on the com- 
puter 19. 

[0117] In a further embodiment, the foundation may 
have separate command areas where the user writes a 
command with the pen or stylus 1 3 which is detected 
and converted by the character recognizing system to 
a command understandable to the computer. The com- 



puter then performs the command which could be or- 
dering the GUI and the computer to store a snapshot of 
the present picture drawn on the foundation 10. 
[0118] The command areas may be shown on the 
foundation 10 by projecting a command area image onto 
the foundation with the projector 24. If the GUI and the 
computer 19 know that the areas on the foundation are 
used only for commands or other similar character 
based information, it is possible to have these areas sur- 
veyed by the GUI. At the same time, any problems with 
accidental conversion of non-characters on the founda- 
tion into actual characters is avoided. 
[01 1 9] Figure 5 further illustrates a reference area RA 
on the foundation 10 where the position detection sys- 
tem is capable of detecting a pointer 13 such as a pen 
or a stylus when it is within the area. 
[0120] It is also illustrated that there are storage 
means ST for storing of data such as the position data 
and the data of the images to be projected. In a preferred 
embodiment of the Invention the storage means ST is 
Incorporated in one of the system components e.g. the 
penholder 18 or as a separate component connected to 
one of the system components. The storage means ST 
may however also be storage means such as a hard 
disc in a computer connected to the position detection 
system. 

[0121] In further preferred embodiment of the inven- 
tion the position detection system and the computer 19. 
23 each has storage means ST e.g. a primary storage 
in the penholder 16 and a larger secondary storage in 
the computer. The coniputer storage may then be the 
final storage while the penholder storage will be a buffer 
in an asynchronous data communication between the 
two. 

[0122] Fig. 5b shows a flowchart Illustrating the prin- 
ciple operations of the above described embodiment of 
the invention. 

[0123] Image data ID is provided to an image gener- 
ating means, such as a projector IP. 24. The projector 
projects an image I corresponding to the image data ID 
on the above-described foundation. The image I project- 
ed on the foundation may preferably t>e assigned to a 
reference area RA of the foundation. 
[0124] This assignment may be performed in many 
different ways, if needed. An example of such an assign- 
ment may e.g. be performed by the user by means of 
four reference points made on the reference area in or- 
der to "teir the detecting system that the overtay Image 
is within the manually established reference points. 
When applying e.g. a whiteboard or a standard black- 
tx>ard as a foundation, a user may draw or point at the 
foundation by means of a polnterl 3. within the reference 
area RA 

[0125] Subsequently, or rather simultaneously, point- 
ing made be the user may be recorded by means of the 
position detector system PD, and the established data 
representation of the pointing (e.g. writing) may be con- 
verted into a data representation DR. This data repre- 
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sentation DR, preferably established on a realtime ba- 
sis, may then be transferred Into a data format DF. This 
data format DF moreover refers to the original image I 
represented by the image data ID. 
[0126] Evidently, the position detector system may 
map the detected positions of the pointer 1 3 directly into 
the data format If so desired within the scope of the in- 
vention. 

[01 27] The important thing is that both the Image data 
ID and the data representation DR may be established 
in such a way that the data may be visualized simulta- 
neously e.g. in an image reader (data format viewer) on 
a computer 19. preferably maintaining the representa- 
tion as a "cartoon" overiay to the projected Image I. 
[01 28] Moreover, the data format DF may stored on a 
data storage DS. 

[0129] The positions may be mapped into numerous 
different applicable data representations suitable for the 
purposes, such as different types of bitmaps or vector 
based formats. 

[0130] According to the invention, the pointer posi- 
tions may be stored in a relationship to the image data, 
thereby maintaining the mutual relationship between the 
recorded pointer position(s) and the image generated 
on the reference area. Thus, a complete image repre- 
senting both the "background" image and the image 
generated by the pointer may be established. 
[0131] Accordingly, the embodiment of the Invention 
provides a possibility of providing an image on e.g. a 
whiteboard or at least a white background, detecting 
and storing the positions of a pointer drawing "on" the 
image In such a way that a complete image of both the 
projected (generated) image and the drawing made by 
the pointer may be stored. 

[01 32] Evidently, such an image may be stored in sev- 
eral different ways, e.g. In a traditional CAD program, 
where one the layers is the generated image and where 
another layer comprises the drawing made by the point- 
er "on" the generated or projected image. Accordingly, 
the recorded pointer positions may be edited without ed- 
iting the background image. 

[0133] Figure 6 shows an example of a GUI 30 to op- 
erate on a computer 19 where the GUI may be used in 
connection with a position detection system. The sys- 
tem will usually operate in a Windows-based environ- 
ment but it will, of course, also be possible to make ver- 
sion for Macintosh or other kinds of computers. 
[0134] The GUI 30 works as a sort of recorder which 
continuously records the position data from the position 
detectors 1 1 , 1 2 by means of the computer program and 
time controller. The created record comprises all posi- 
tion data and the time of recording the data. 
[01 35] The GUI also has the function of displaying the 
position data to a user of the system. A preferred GUI 
30 according to the invention is divided Into a number 
of areas including an image monitoring area 31 , a snap- 
shot monitoring area 45, a text monitoring and/or editing 
and a time line area 44. 
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[0136] The image monitoring area 31 displays a 
present image which reflects a picture drawn onto the 
foundation 10 as detected by the detectors 11,12. The 
image may also comprise integration of a picture and a 
5 projected image where the integration can be in the form 
of independent layers on top of each other or semi- or 
fully integrated images. If integration between the imag- 
es is complete, it will be possible to let one of the images 
be the GUI 30 of a computer program such a financial 

10 or database program. Another image will include char- 
acters written with the pen or stylus 1 3 on the foundation 
10 and recognized and converted by the above-men- 
tioned character recognizing system. The converted 
characters will be used directly or stored in the computer 

IS programs. 

[0137] In an advanced embodiment of the GUI 30. it 
will also be possible to change the image or add to the 
Image when it is in the image monitoring area 31. 
[01 38] The time line area 44 shown in figures 3 and 4 

20 comprises two time lines 39, 40 where the first time line 
39 Is a total time line. The beginning of the time line 39 
Is the beginning of the detection session and the end of 
the time line 39 is the present time. This means that the 
resolution of the time line will decrease as time passes 

25 in the detection session. The time line is controlled by 
the program processor including a time generator 23e 
and creates a connection between the program proces- 
sor including a time generator 23e, the time lines 39. 40 
and the detected position data. 

30 [0139] The time line 39 also has a position Indication 
marker 41 which is slideable along the time line allowing 
the user to go back in the recorded position data. If the 
marker 41 is moved along the time line, the position data 
will be displayed and it will hereby be possible see the 

35 development of an image. The size of the marker 41 is 
changeable by the user Le. by means of a computer 
mouse 23d by dragging one of the sides of the marker 
41. 

[0140] The second time line 40 is a subset of the first 
40 time line 39 allowing improved time resolution. Figure 7 
shows a preferred embodiment of the time lines 39. 40 
where the size of the mariner 41 controls the point of be- 
ginning 46 and end point 47 of the second time line 40 
and thereby the resolutton of the second time line 40. 
45 The marker also has a cursor 49 incorporated where the 
cursor is used to illustrate the exact present location on 
the time lines. 

[0141] Figures 6 and 7 also show that the time lines 
39, 40 can Indicate the time of one or more special ac- 

50 tions. In this example, the indications 42, 43 indicate the 
time of two snapshots 33, 34 on the second time line 40. 
[01 42] The snapshots 32-35 are a functk>n of the sys- 
tem which allow the user of a position detection system 
to store the image present in the image nrK>nitoring area 

55 31 i.e. for later recall and use. The recall of a snapshot 
is possible by clicking on the thumb image of the snap- 
shot in the snapshot area 45 or on the indicator 42. 43 
on the first or second time line 39. 40. 
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[0143] The snapshot area 45 includes a number of 
snapshots 32-35 with accompanying sound and/or text 
comments. The image will be stored together with infor- 
mation of the time of storage. It Is also possible store 
sound together with image i.e. a microphone recording 
of the comments stated when drawing the picture on the 
foundation 10. 

[0144] Further, it is possible to write comments in the 
text area 38 of the GUI 30 by means of the keyboard 
23b of the computer 19, 23. The text comments will be 
stored together with the image and, if present, the sound 
in a complete snapshot. In continuation of recalling a 
previously stored snapshot, the sound will be played 
and the comments will be visible in the text area 38. 
[01 45] Whether a snapshot is accompanied by sound 
and/or text is illustrated by signs. The first sign is a 
sound indication means 36 and the second sign a text 
indication means 37 and if the signs are indicated next 
to the thumb image In the snapshot area, they are 
present. In an embodiment of the GUI 30. it wilt be pos- 
sible to hear the sound or read the text by clicking on 
the right sign 36, 37. 

[0146] Figure 8 illustrates the principles of a time line 
grabber TLG. The time line grabber grabs a section of 
a time line 39, 40, and makes a time line monitor TLM 
create a new time line. The new time line will have other 
time resolutions than those of the grabbed time line and 
the time line grabber TLG and the monitor TLM work as 
a sort of zoom function between time lines. The resolu- 
tion of the new time line may be constant or change over 
time. The grabber TLG may grab more than one time 
line and hereby create several time lines. The time line 
which is initially grabbed Is not necessarily the one that 
will be grabbed next. An example of this is a situation 
where every new time line is created on the basis of the 
immediately preceding time line. 
[0147] Figure 9 illustrates a preferred embodiment of 
the invention where the GUI 30 has snapshot selecting 
means 51a-51h in a snapshot selection area 51. The 
snapshot selecti ng means works a keyboard comprising 
a number of buttons for; playing a snapshot comprising 
a sequence of images, pausing or stopping play, fast 
rewind or fast forward in the sequence and Jumping back 
and forth to the next snapshot. The snapshot selecting 
means 51 a-51 h also comprise a button for recording the 
data from the position detector 11,12 and/or for record- 
ing a snapshot 32-35. 

[0148] The figure also illustrates that the GUI 30 pref- 
erably works in a Windows-orientated environment with 
scroll bars 53 and "close window** functions 52. 
[0149] Figure 10 illustrates some of the possible 
snapshot combinations. When activated, the first snapr 
shot 32 will comprise a sequence of images 59 where 
the sequence is the position data recorded in a time pe- 
riod after storing of the first snapshot 32. The activation 
and direction of the sequence are illustrated by an arrow 
55 under a section of a time line 54. 
[0150] The sequence 59 is accompanied by a sound 



recording during the time period or a recording per- 
formed later but subsequentiy linked to the snapshot 
and the time period. The first snapshot 32 is also ac- 
companied by text illustrated by the text indication 

5 means 37. 

[0151] The second snapshot 33 comprises a se- 
quence of Images 60 where the sequence is the position 
data recorded during a time period between the storing 
of the second snapshot 33 and the third snapshot 34, 

10 The user's active storage of the third snapshot 34 ended 
the recording in connection with the second snapshot 
33. The sequence 60 is accompanied by a sound re- 
cording. The second snapshot 33 is also accompanied 
by text illustrated by the text indication means 37 and 

IS the dlrectk>n of the sequence is illustrated by an arrow 
57 under a section of a time line 56. 
[01 52] The third snapshot 34 only comprises one im- 
age 61 and does therefore not have an arrow under its 
section of the time line 58. It has no accompanying 

20 sound or text comments which is illustrated by the ab- 
sence of any sound or text indicator 
[0153] Many other combinations of snapshot types, 
sequences, directions of sequences etc. are possible 
within the scope of the invention. 

25 [01 54] Figure 1 1 illustrates the possibility of exporting 
and importing a snapshot or even the present GUI as 
whole between connected computers. After having 
used the position detection system, it is often advanta- 
geous to be able to export a snapshot to another per- 

30 son*s computer e. g. for getting that person's comments 
to the snapshot. 

[0155] The GUI 30 has the ability to store the desired 
snapshot 61 in a preferred file format and thereby create 
the possibility of sending the file by e-mail to other com- 

35 puters 62 where all the computers are connected to 
each other i.e. through the Intemet. it is also possible to 
store the snapshot as an HTML document and subse- 
quently upload the document to a homepage or forward 
the snapshot as an SMS message or a similar type of 

40 message to a mobile telephone 63. 

[0156] In an advanced embodiment, the computers all 
have the necessary software to receive i.e. snapshots 
and text may be written direcUy in the accompanying text 
area or changes of the Images be made. After having 

45 commented or changed the snapshots, they may be re- 
tumed to the sender and the sender will receive the 
snapshot directiy in the GUI with the comments and/or 
changes. 

50 iReference numbers 

[0157] 

1 0. Foundation such as a white- or a blackboard 

55 11,12. Position system detectors 

1 3. Pointing device such as a pen or stylus 

14, 15. Light emitters 

16. Connection t>etween detectors 
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17. Connection between detectors and holder 62. A further computer 

18. Penholder 63. Communication device 

19. Computer 64. Connection between computers 

20. Loudspeaker of the computer 65. Connection between computer and com- 

21. Loudspeaker and/or light emitters In the pen- s munication device 
holder RA. Reference area 

22. Connection between holder and computer I. Image 

23. Computer 19 with a graphical user interface ID. Image data 
23a. Central unit of the computer ST, Storage means 
23b. Keyboard of the computer io SRM. Routing means 
23c. Computer screen FS. Fault states 
23d. Computer mouse NFS No-fault states 
23e. Program processing means including a time TL. Time line 

generator TLG. Time line grabber 

24. Image generation system such as a projector is TLM. Time line monitor 

25. Connection between image projector and 
computer 

26. Drawing image Claims 

27. Projected image 

28. Drawing information area 20 1. Position detection system comprising 

29. Drawing information at least one pointer device (13) 

30. Graphical user interface (GUI) at least one detector (11.12) adapted for de- 

31. Image monitoring area tecting the position ofthe at least one pointer device 

32. First snapshot (13), 

33. Second snapshot 25 signal processing means (19, 23a; 23e) for 

34. Third snapshot controlling the said at least one detector (11, 12) 

35. Fourth snapshot said system comprising a user interface. 

36. Graphical sound indication means 

2. Position detection system according to claim 1, 

37. Graphical text Indication means 30 wherein said user interface comprises 

38. Text monitoring and/or editing area at least one light emitting anrangement (14. 

39. Complete time line 15), 

40. Relative time line at least one sound emitting arrangement (20. 

41. Position indication marker 21), 

42. Time indication of a second snapshot 35 routing means (SRM) 

43. Time indication of a third snapshot said routing means (SRM) being adapted to 

44. Time line area routing fault states (FS) to said sound emitting ar- 
. 45. Snapshot monitoring area rangement (20, 21) and to routing no-fault states 

46. Starting point (NFS) to the light emitting arrangement (14. 15). 

47. Ending point 40 

48. Integrated image 3. Position detection system according to daim 1 or 2, 

49. Time indicator such as a cursor wherein the at least one light emitting arrangement 

50. Direction arrow (14, 15) comprises light indication means (14, 15) 

51. Snapshot selecting means Integrated in the position detectors (11, 12), 
51a-51g. PLAY/PAUSE 51g. REWIND 51d, FOR- « 

WARD 51b, STOP 51 f. RECORD 51c. 4. Position detection system according to any of 

JUMP FORWARD 51a. JUMP BACK51e claims 1-3. wherein said user interface comprises 

52. "dose window" fiinctton at least one light emitting anrangement (14, 15). 

53. Scrollbar 

54. Section of a time line so 5. Position detection system according to any of 

55. An-ow indicating the direction of travel daims 1-4, wherein the at least one light emitting 

56. Section of a time line arrangement (14,15) comprises a light emitting ar- 

57. Arrow indicating the direction of travel rangement (14. 1 5) integrated in the position detec- 

58. Section of a time line tors (11, 12). 

59. Snapshot with a sequence of images ss 

60. Another snapshot with a sequence of im- 6. Position detection system according to any of 
ages claims 1-5. wherein said user interface comprises 

61 . Snapshot at least one sound emitting arrangement (20, 21 ). 
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7. Position detection system according to claims 1. 3, 
and 4, wherein said system comprises routing 
means (SRM), said routing means (SRM) being 
adapted to routing predefined fault states (FS) and 
no-fault states (NFS) to signaling means (14, 15, 
20. 21), 

8. Position detection system according to daim 7. 
wherein said routing means (SRM) routes the fault 
states (FS) to said sound emitting arrangement (20, 
21 ) and routes the no-fautt states (NFS) to said light 
emitting arrangement (14, 15). 

9. Graphical User Interface (30) for displaying data 
from a position detection system according to daim 
1 , said GUI comprising 

program processing means including a time refer- 
ence generator (23e) 

means for recording and storing a sequence of im- 
ages (59. 60, 61 ), said images (59, 60, 61 ) referring 
to a time reference provided by said time reference 
generator (23e) 
at least two time lines (39, 40) 
at least orie image monitoring area (31 , 45) adapted 
to monitoring images of said recorded and stored 
sequence of images (59, 60, 61 ) with reference to 
at least one of said time lines (39, 40), 
at least one of said time lines (40) being adapted to 
monitoring a sub-interval of at least one of said at 
least two time lines (39). 

10. Graphical user interface (30) according to daim 9. 
wherein an image displayed at the at least one im- 
age monitoring area (31) refers to a cursor (49) re- 
ferring to at least one of said at least two time lines 
(39.40). 

. 11. Graphical user interface (30) according to daim 9 
or 10 wherein the at least two time lines (39, 40) 
have different time resolutions. 

12. Graphical user interface (30) according to any of 
daims 9-11 wherein the GUI further includes a 
snapshot monitoring area (45) comprising one or 
more snapshots (32; 35). 

13. Graphical User Interface (30) according to claim 12 
wherein a snapshot (32; 35) includes one (61) or a 
sequence (59, 60) of images. 

14. Graphical User Interface (30) according to any of 
daims 9-13 wherein the GUI further indudes a text 
monitoring and/or editing area (38). 

15. Graphical User Interface (30) according to any of 
daims 9-14 wherein text of the text monitoring and/ 
or editing area (38) is linked to at least one snapshot 
(32; 35). 



16. Graphical User Interface (30) according to any of 
daims 9-15 wherein at least one piece of sound is 
linked to at least one snapshot (32; 35). 

5 17. Graphical User Interface (30) according to any of 
daims 9-16 wherein at least one of the snapshots 
Is In a data format allowing exporf and/or import of 
said snapshots between computers (23, 62) or be- 
tween a computer and at least one other communi- 

10 cation device (63). 

18. Graphical User Interface (30) for displaying data 
from a position detection system according to daim 
1 and at least one image generating system (24), 
IS said GUI (30) comprising 

a program processor induding a time generator 
(23e) 

wherein at least one integrated image (48) is creat- 
ed by integrating the at least one image (26. 27) of 
20 the position detection system parity or completely 
in the at least one Image of the image generating 
system (24) in relation to the time of the program 
processor induding a time generator (23e). 

25 19. Graphical User Interface (30) according to daim 18, 
wherein said integrated image (48) is completely or 
partiy scanned by a character recognizing system. 

20. Graphical User Interface (30) according to claim 1 8 
30 or 19 wherein the result of said scanning is stored 

in one or more programs on at least one computer 
(23) and/or controls said one or more programs. 

21. Position detection system comprising 

35 at least one position detector (11.12) for detecting 
the position(s) of at least one pointer (1 3) on at least 
one reference area (RA) 

means for mapping said position(s) relative to said 
at least one reference area (RA) into at least one 
40 data representation 

at least one image generating system (24) adapted 
for generating at least one image (I) on said at least 
one reference area (RA) according to image data 
(ID. BMP). 

4S said system comprising means for storing the said 
pointer position(s) (13) relative to the image data 
(ID) generated on the reference area (RA). 

22. Position detection system according to daim 
so 21 .wherein the said image generating system (24) 

comprises an image projecting system. 

23. Position detection system according to daim 21 or 
22. wherein the said means for storing the said 

55 pointer position(s) (13) relative to the image data 
(ID) generated on the reference area (RA) are 
adapted for merging at least one data representa- 
tion and the at least one image data into one image 
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* file. 

24. Position detection system comprising 

at least one position detector (11.12) for detecting 
the position(s) of at least one pointer (1 3) on at least 
one reference area (RA) 

means for mapping said position(s) relative to said 
at least one reference area (RA) into at least one 
data representation 

at least one Image generating system (24) adapted 
for generating at least one image (I) on said at least 
one reference area (RA) according to image data 
(ID) 

said Image generating system generating an image 
representing the dynamic Interface of a computer 
program running on a computer, 
said system comprising character recognition 
means for converting at least some of the said data 
representations into digitally represented charac- 
ters, and said system comprising means for insert- 
ing the said digitally represented characters into the 
running program via the said dynamic computer In- 
terface. 
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providing the image on a reference area (RA), 
detecting the position(s) of at least one pointer rel- 
ative to a reference area (RA), 
representing the image representing data (ID) and 
the detected position(s) in such a way that a com- 
bined merged image may be retrieved or visualized. 

31. Use of a position detection system according to 
daim 1 and a Graphical User Interface according to 
any of the claim 18-20 for controlling one or more 
computers. 



25. Position detection system according to daim 24 
wherein the said image generating system (24) 
comprises an Image projecting system. 
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26. Graphical User Interface (30) for displaying data 
from a position detection system according to daim 
1 , said GUI comprising a snapshot monitoring area 
(45). 

said snapshot monitoring area (45) incorporating 
snapshot selecting means (51). 
said snapshot selecting means (51) facilitating 
the display of at least one of the images (59, 60, 61 ) 
associated with the selected snapshot. 



30 



27. Graphical User Interface according to claim 26. 
wherein said snapshot selecting means (51 ) facili- 40 
tates display of a sequence of images (59, 60, 61) 
starting with the image assodated with the selected 
snapshot (32-35). 

28. Graphical User interface according to claim 26 or 45 
27 wherein the snapshot selecting means (51 ) com- 
prises a PLAY control (51 g). 



29. Method of communicating the state of a system ac- 
cording to daim 1 to a user, said method comprising 
the steps of 

indicating at least one system fault by means 
of sound 

indicating that the system works property by 
means of visual indicating means (14, 15) 
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30. Method of merging data into an image (I), said step 
comprising the steps of 
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